Method and system for targeted commerce in network broadcasting

ABSTRACT

A system and a method for using the system for targeted commerce in network broadcasting are provided. The system includes an interface device configured to receive a multimedia stream from a network, wherein the multimedia stream includes a close captioning string and wherein the interface device is further configured to process the multimedia stream by providing advertisements in the multimedia stream according to a correlation between the close captioning string and a plurality of vendor keywords; and a viewing device configured to receive the processed multimedia stream and display to a viewer.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 13/719,747, filed on Dec. 19, 2012, which is hereinincorporated by reference. The present disclosure is also related toU.S. patent application Ser. No. 13/529,905, entitled “Method and Systemfor Targeted Broadcast Advertising”, by Chad Anthony Geraci, filed onJun. 21, 2012 and published as U.S. Pat. Appl. Publ. No. 2013/0347032,which is herein incorporated by reference.

BACKGROUND

1. Field of the Invention

Embodiments disclosed herein relate generally to the field of commercein multimedia broadcasting; more particularly, embodiments disclosedherein relate to the field of targeted commerce in network broadcasting.

2. Description of Related Art

In state-of-the-art network broadcasts, commercials may not becorrelated with a broadcasting program, be it a TV show or a videodownstream from a media outlet. Therefore, vendors may missopportunities to advertise products, and may pitch products toinappropriate or uninterested audiences, wasting resources. Typically,advertising strategies are matched to audiences modeled by broadcastersprior to broadcasting, based on marketing strategies, program ratings,and program schedules. While these marketing models have becomeincreasingly complicated, there are still inefficiencies in thestrategies used. Moreover, with the advent of new consumer electronicdevices and network capabilities, potential consumers may be watching aprogram at any time of the day, in any place. Audiences have becomedispersed geographically and chronologically, making current marketingmodels obsolete and inappropriate.

Furthermore, in many instances a viewer may be interested in purchasingan item immediately, while watching a broadcast. The sale is potentiallylost when the viewer has no direct purchasing access to the item, sincethe viewer's attention may shift away from the item at a different timeduring or after the broadcast.

What is needed is an alternative method of commerce in networkbroadcasting that is flexible and increases sales opportunities forbuyers and vendors.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a system for targeted commerce in network broadcasting,according to some embodiments.

FIG. 2 shows a display in a system for targeted commerce in networkbroadcasting, according to some embodiments.

FIG. 3 shows a display in a system for targeted commerce in networkbroadcasting, according to some embodiments.

FIG. 4 shows a display in a system for targeted commerce in networkbroadcasting, according to some embodiments.

FIG. 5 shows a flow chart in a method for providing targeted commerce innetwork broadcasting, according to some embodiments.

FIG. 6 shows a flow chart in a method for providing targeted commerce innetwork broadcasting, according to some embodiments.

FIG. 7 shows a flow chart in a method for providing targeted commerce innetwork broadcasting, according to some embodiments.

In the figures, elements having the same reference number have the sameor similar functions.

DETAILED DESCRIPTION

According to some embodiments a system for targeted commerce in networkbroadcasting includes an interface device configured to receive amultimedia stream from a network, wherein the multimedia stream includesa close captioning string and wherein the interface device is furtherconfigured to provide advertisements in the multimedia stream accordingto a correlation between the close captioning string and a plurality ofvendor keywords; and a viewing device configured to receive theprocessed multimedia stream and display the multimedia stream to aviewer.

According to some embodiments, a system may include a server, the serverincluding a processor circuit and a memory circuit, wherein: theprocessor circuit is configured to: provide a network link to aninterface device, the network link embedded in an advertisement, and toprovide a viewer purchase profile to the interface device, the viewerpurchase profile including items of interest for a viewer; access avendor account through the network, and store the vendor accountinformation in the memory circuit; access an account for the viewerthrough the network; and transfer funds from the viewer account to thevendor account upon a viewer selection of the network link embedded inthe advertisement.

According to some embodiments, a non-transitory machine-readable mediumincluding a plurality of machine-readable instructions which whenexecuted by one or more processors of an interface device are adapted tocause the interface device to perform a method including: receiving amultimedia stream from a network, the multimedia stream including aclose captioning text; finding correlation values between the closecaptioning stream and a plurality of vendor keywords; and providing anadvertisement in the multimedia stream according to the correlationvalues.

According to embodiments disclosed herein, a method for targetedcommerce in network broadcasting may include storing, electronically ina memory circuit of an interface device a plurality of keywords relatedto an item for sale by a vendor; finding, electronically by a processorcircuit in the interface device correlation values between vendorkeywords and a close captioning in a multimedia stream; placing anadvertisement field for the item at selected locations in the multimediastream according to the correlation values; placing a payment tab on theadvertisement field; and displaying an advertisement in theadvertisement field at pre-determined events performed by a vieweraccessing the multimedia stream.

Embodiments in this disclosure include methods and systems for usingclosed captioning for targeted commerce in network broadcasting. Thebroadcast may include a multimedia stream provided through a broadcastmedium. The broadcast medium may be open space, electrical cables andwires, fiber optics networks, or a combination of the above. Targetedcommerce includes advertisements relevant to the broadcast content sothat the viewer will be naturally interested in the advertisement.Targeted commerce may also include the ability for the viewer toimmediately purchase an advertised item using a network and a serviceprovider on the network. In any given program broadcast including video,close captioning is keyword rich by nature. Close captioning in abroadcast may be used for targeted commerce by matching a keyword ofinterest for advertising and immediate sale of a product or service toan appropriate audience.

According to some embodiments, an interface device receiving amultimedia stream through a network queries closed captioning text inthe stream. The interface device matches specific products or terms withadvertisements that read upon the product in the close caption text. Orthat share enough similarity with the product in the close caption textsuch that the advertisement is “relevant.” The similarity between anadvertised product and the multimedia stream content may be measuredusing a correlation function between a vendor provided keyword and theclose captioning text. The keyword may be selected from a list ofkeywords stored in the interface device. The correlation function may bein the form of a language correlation. A correlation function may have alarger value if the keyword for the item is literally included in theclose captioning. In some embodiments, a correlation function may have alarge value when an item matching the keyword description is displayedin a frame of the multimedia stream.

FIG. 1 shows a system 100 for targeted commerce in network broadcastingaccording to some embodiments. System 100 includes a service provider101, a vendor 105, a broadcaster 110, and a network 150. Broadcaster 110generates a multimedia stream 120 that is transmitted through network150. Broadcaster 110 may be a traditional TV station or network, or aweb-based server providing video content. For example, broadcaster 110may be a news outlet providing content to the internet, a video sourcelinked to a search engine, or a server providing movies to registeredusers.

According to some embodiments, multimedia stream 120 is received by aninterface device 130. Interface device 130 processes multimedia stream120 using a processor circuit 132. Processor circuit 132 operates onmultimedia stream 120 by executing commands stored in a memory 133.Interface device 130 may store portions of multimedia stream 120 inmemory 133, using processor circuit 132. Memory 133 may include a memorycircuit and a recordable medium, such as a DVD, a hard drive, a flashdrive, or any other recordable medium, such as a non-transitory, machinereadable medium. In some embodiments, interface device 130 may include a‘wish list’ 134 stored in memory 133. Purchase profile 134 includeslists of items that viewer 160 may be interested in purchasing. Purchaseprofile 134 may include a generic list of items, such as ‘books’, or‘men's clothing’, or ‘women's clothing’. In some embodiments, purchaseprofile 134 may be more specific, such as ‘kitchen supplies’, ‘surfinggear’, ‘women's shoes’, or the like. Items in purchase profile 134 mayinclude also services such as ‘travel’ or ‘mobile phone plans’ or‘health’.

Interface device 130 provides the processed multimedia stream to aviewer 160 on a viewing device 170 including a display 175. Interfacedevice 130 may receive multimedia stream 120 from network 150 via a freespace antenna (such as a dish), a cable connection, or any other form ofnetwork connection through network link 183. Viewing device 170 may be aTV display, a cell phone, a laptop, a computing tablet, a smart phone,or a desktop computer. Interface device 130 may perform digital dataprocessing on multimedia stream 120. For example, interface device 130may perform analog-to-digital conversion when multimedia stream includesanalog data. In some embodiments, interface device 130 may bufferportions of multimedia stream 120 prior to providing the processedstream to viewing device 170. According to some embodiments, interfacedevice 130 may include an advertisement 135 in multimedia stream 120,displayed to viewer 160 by viewing device 170. Advertisement 135 may bea targeted advertisement, selected according to close captioning 121 andmetadata 122 in multimedia stream 120, and also selected according to‘wish list’ 134.

FIG. 1 illustrates a service provider 101, such as PayPal, Inc. of SanJose, Calif., having a link 181 to network 150. Vendor 105 includes alink 182 to network 150. Each one of links 181, 182, and 183 may be partof a network. For example, links 181, 182, and 183 may be a cell phonenetwork, a wireless network, an Ethernet network, or any combination ofthe above. In some embodiments vendor 105 may be a registered user ofservice provider 101. In some embodiments, viewer 160 may also be aregistered user of service provider 101. In some embodiments, serviceprovider 101 may include a computer having a processor circuit 102 and amemory circuit 103. Thus, the operations of service provider 101 asdescribed below may be performed electronically by processor 102executing commands and using data, the commands and the data stored inmemory circuit 103.

Vendor 105 may use an account in service provider 101 to provide aremote payment mechanism for viewer 160, in advertisement 135. Viewer160 may use an account in service provider 101 to pay for an item usinga remote payment option placed by interface device 130 for vendor 105,in advertisement 135.

Multimedia stream 120 may include metadata 122 and a close captioningstring 121. Interface device 130 inserts advertisements 135 inmultimedia stream 120 according to a correlation between metadata 122,close captioning 121, and a plurality of vendor keywords 107. Vendorkeywords 107 may be provided by vendor 105 to interface device 130 upona contract agreement with the manufacturer of interface device 130.Vendor keywords 107 describe or characterize the main aspects of aproduct offered for sale by vendor 105. For example, in some embodimentskeywords 107 may be placed in memory 133 of interface device 130 at thetime of assembly of interface device 130. In some embodiments, vendorkeywords 107 may be provided by vendor 105 through network 150, usinglinks 182 and 183.

In some embodiments, interface device 130 may provide advertisement 135according to purchase profile 134. In such embodiments, interface device130 may further use purchase profile 134 to perform a correlation withmetadata 122, close captioning 121, and vendor keywords 107. Interfacedevice 130 may have information as to the identity of viewer 160 priorto, or during, the broadcasting of multimedia stream 120. Thisinformation may be obtained by interface device 130 when viewer 160 logsin, to access program content from broadcaster 110. In some embodiments,purchase profile 134 may be created in interface device 130 following ahistory of purchases by viewer 160. Based on the correlation, interfacedevice 130 may determine a targeted advertising to display for viewer160. The targeted advertisement may best match the viewer's expressedinterest on an item to a broadcast content. Accordingly, advertisements135 may be retrieved by interface device 130 from network 150 using link183. For example, once a match is found in interface device 130 for anitem in close captioning 121 or metadata 122, interface device 130 maylook for a selected advertisement in network 150. Interface device 130may download the advertisement and place it in processed multimediastream 120 to be displayed for viewer 160. Processed multimedia stream120 may be stored by interface device 130 in memory 133. Thus, selectedadvertisement 135 may be played in viewing device 170 repeatedly, asviewer 160 may desire to replay the program content in multimedia stream120.

While FIG. 1 illustrates element 105 as a vendor, it should beunderstood by those of ordinary skill that element 105 may be anyorganization that collects funds through advertisement. For example, anon-profit organization dedicated to charity or any other activity usingfunds from the viewing audience may use methods and systems for targetedbroadcast advertising as disclosed herein. In this regard, aidorganizations established on a permanent basis (disease research orvaccination campaigns) or in natural disasters, may use methods andsystems for targeted commerce in network broadcasting as disclosedherein.

According to some embodiments, interface device 130 and viewing device170 may be part of the same television unit, co-local with viewer 160.For example, interface device 130 may be a circuit embedded into viewingdevice 170. In some embodiments interface device 130 may be a separatebox coupled to network link 183 on one end and coupled to viewing device170 on another end.

FIG. 2 shows a display 255 in a system for targeted commerce in networkbroadcasting, according to some embodiments. Display 255 includes acanvas 220 to display the program content, and an advertisement field230 to display a targeted advertisement. In some embodimentsadvertisement field 230 includes a payment tab 240. In some embodimentspayment tab 240 may be provided by private account service provider 101.Thus, a viewer interested in purchasing some of the advertised productsmay select payment tab 240 and complete a transaction using network 150,while watching the program content. According to some embodiments,advertisement field 230 may display targeted advertisement 135 whileprogram content 220 is streaming continuously. Thus, targetedadvertisements 135 may be placed in advertisement field 230 according toa strong correlation with the streaming close caption string 121, thevisual display in program content 220, and keywords 107. Targetedadvertisements as displayed in field 230 including payment tab 240 sothat a viewer may immediately purchase an advertised item or service mayreferred to as ‘smart ads.’

Interface device 130 embeds advertisement 135 in multimedia stream 120when a specific product name has been mentioned in closed captioning121. In some embodiments, interface device 130 displays advertisement135 when a correlation match occurs for a vendor's product in relationto close captioning 121, metadata 122, and purchase profile 134. In someembodiments interface device 130 displays advertisement 135 when aspecific product name appears in close captioning 121 and the product isalso visually displayed in a frame in broadcast program 220. In someembodiments interface device 130 displays advertisement 135 when ageneric item is mentioned in close captioning 121. The generic item maybe related to vendor keywords 107, or a viewer's purchase profile 134.In some embodiments interface device 130 displays advertisement 135 whena generic item is shown in the broadcast program.

Further according to embodiments consistent with the present disclosure,interface device 130 displays advertisement 135 when a correlation matchoccurs between close captioning 121 and purchase profile 134. In someembodiments, interface device 130 compares a correlation match topurchase profile 134; if there is a match, displaying advertisement 135may include a cost to vendor 105. Further according to some embodiments,interface device 130 may display advertisement 135 in multimedia stream120 for products or services in purchase profile 134 matching vendorkeywords 107. In some embodiments, service provider 101 may providepurchase profile 134 through link 183 to be stored in memory 133 ininterface device 130. According to some embodiments, a revenue streammay include a fee charged by service provider 101 to either vendor 105,viewer 160, or both. In some embodiments, advertisement 135 may beplaced in multimedia stream 120 by broadcaster 110. In suchconfiguration, broadcaster 110 may receive a payment from vendor 105,for placing advertisement 135 in multimedia stream 120. Configurationswhere broadcaster 110 places advertisement 135 in multimedia stream 120may be as disclosed in detail in U.S. patent application Ser. No.13/529,905, entitled “Method and System for Targeted BroadcastAdvertising”, by Chad Anthony Geraci, filed on Jun. 21, 2012 andpublished as U.S. Pat. Appl. Publ. No. 2013/0347032, the contents ofwhich are herein incorporated by reference, in their entirety, for allpurposes.

Interface device 130 may select to display advertisement 135 for viewer160 at any point during a broadcast. Accordingly, interface device 130may display advertisement 135 in multimedia stream 120 while programcontent 220 is paused by viewer 160. Thus, more than one advertisement135 may be inserted in multimedia stream 120 by interface device 130, ifmore than one vendor item has obtained a high correlation value.According to some embodiments, interface device 130 may store in memory133 a number of vendor items that have reached a high correlation valuebetween a first point in multimedia stream 120 and a second point inmultimedia stream 120. For example, the first point and the second pointin multimedia stream 120 may be a ‘pause’ action or a ‘fast forward’action by viewer 160 in the program. In some embodiments, a first pointin multimedia stream 120 may be the start of program content 220, and asecond point in multimedia stream 120 may be the end of program content220.

According to some embodiments, viewer 160 may pause program content 220when an item of interest is advertised in advertisement field 230.Further according to some embodiments, display of advertisement field230 may be optional, by viewer 160. Upon pausing program content 220, aninteractive box 225 may appear in program content 220 requesting inputfrom viewer 160 as to whether or not advertisement field 230 should bedisplayed. The viewer may use payment tab 240 to purchase an advertisedproduct or service, such as by selecting payment tab 240 via a remotecontrol device, a user touch, or a pointing device. In such embodiments,viewer 160 may decide to turn advertisement field 230 ‘on’ when an itemof interest appears on display 255. Viewer 160 may decide to turnadvertisement field 230 ‘on’ when an item or service of interest ismentioned in the context of program content 220. For example,interactive box 225 may stay on display 255 for a selected period oftime, predetermined by interface device 130. The period of time may bedetermined upon a contract between vendor 105, and the manufacturer ofinterface device 130.

In some embodiments, viewer 160 may be a registered user with serviceprovider 101, having an account login and a password or personalidentification number (PIN). Thus, when viewer 160 presses or taps onpayment tab 240, viewer 160 may be directed to service provider 101through network 150. Viewer 160 may then be prompted to enter accountlogin information and a password or PIN, to access a private fundsaccount with service provider 101. When doing so, viewer 160 may thenfinalize the purchase of the product advertised in advertisement field230. In some embodiments, service provider 101 may contact viewer 160 toauthenticate and complete the purchase using e-mail or texting messagesthrough network 150.

In some embodiments consistent with the present disclosure, once thepurchase is authenticated by viewer 160 through network 150, serviceprovider 101 may contact vendor 105 through network 150 to providedetails of the purchase. Furthermore, according to some embodimentsvendor 105 may also be a registered user of service provider 101. Thus,service provider 101 may transfer funds from a viewer account to avendor account within service provider 101 after the purchase has beenauthenticated by viewer 160.

As a method of authentication, viewer 160 may enter a mobile number andpersonal identification number (PIN). The mobile number and PIN may bestored in memory circuit 103 within service provider 101, associated toa viewer's private account. In some embodiments, personal informationfrom viewer 160 may be stored in memory 133. Once service provider 101verifies the viewer's account, the purchase is completed. Serviceprovider 101 transfers funds from the viewer's account to the vendor'saccount when the purchase is completed. According to some embodiments,the fund transfer may take a few minutes, or even less. Upon successfulfund transfer, viewer 160 may receive a confirmation screen on display175 and a receipt from service provider 101. In some embodiments,service provider 101 may send a sales receipt to viewer 160 in emailform, through network 150. In some embodiments, the subject line mayread “Receipt from X merchant” and contain details of the purchaseincluding total, date, and time. One of ordinary skill will recognizethat the specific language using in a communication between serviceprovider 101 and viewer 160 is illustrative only, and not limiting. Insome embodiments an e-mail receipt from service provider 101 to viewer160 may include offers of related items from the vendor. In someembodiments, further offers of vendor's product included in acommunication from service provider 101 to viewer 160 may be part of acontract between vendor 105 and service provider 101.

FIG. 3 shows a display 355 in a system for targeted commerce in networkbroadcasting, according to some embodiments. Display 355 includes acanvas to display a program content 320 and an advertisement field 330to display an advertisement. In some embodiments advertisement field 330includes a payment tab 240, as described in detail above (cf. FIG. 2).Thus, a viewer interested in purchasing some of the advertised productsmay select payment tab 240 and complete a transaction while pausing theprogram content 320. Thus, embodiments consistent with the presentdisclosure provide real-time targeted commerce.

According to some embodiments illustrated in FIG. 3, advertisement field330 may be displayed to the side of display 355, upon viewer 160 takinga specific action on the video display, such as pressing the ‘pause’button as shown by a ‘pause’ indicator 350, or the ‘fast forward’ buttonas shown by a ‘fast forward’ indicator 351. Further according to someembodiments, a product or service advertised in advertisement field 330may be related to a product or service being displayed as part ofprogram content 320. In some embodiments, the product or serviceadvertised in advertisement field 330 may also be related to the contentof a close captioning associated to program content 320. In someembodiments, advertisement field 330 displays a product or servicerelated to a close captioning in program content 320 whether or notviewer 160 has the ‘close captioning’ option ‘on,’ in display 355.Consistent with embodiments disclosed herein, an interactive box 225 maybe placed on program content 320, requesting input from viewer 160 as towhether or not to display advertisement 330.

In some embodiments, a viewer action on display 355 may be a tap on thescreen. For example, viewer 160 may tap on an item that appears onprogram content 320. If the item is related to a product offered forsale by a vendor 105 having a contract with broadcaster 110, or with themanufacturer of interface device 130, then program content 320 may bepaused and advertisement field 330 displayed, including purchaseinformation for the item.

According to some embodiments, viewer 160 may be down-streaming a moviefrom an internet outlet. As the movie progresses, a character in themovie makes a remark including a device or service that may be offeredfor sale by vendor 105. When program content 320 also displays an imageof the device offered for sale by vendor 105, a high correlation betweenthe screen display, the close captioning, and the vendor's keyword mayprompt display 355 to run advertisement field 330 promoting vendor's 105product or service. For example, advertisement field 330 may bedisplayed upon viewer 160 ‘pausing’ program 320 on display 355.Advertisement field 330 may provide further details about the product orservice offered for sale by vendor 105. For example, advertisement field330 may include price, availability, and any other information about aproduct or service, such as store location, and other related productsor services offered by vendor 105.

According to some embodiments, viewer 160 may be watching a broadcast ofa regular TV show in program content 320. As viewer 160 notices an item,utensil or service of interest in program content 320, the viewer may‘pause’ the program 350 to take note of the item, utensil, or service ofinterest. As a result, interactive box 225 queries the viewer's intereston purchasing offers for the item, utensil, or service of interest. Ifviewer 160 gives positive feedback, viewing device 170 displaysadvertisement field 330 including the item, utensil, or service ofinterest. In addition advertisement field 330 may include payment tab240 so that viewer 160 may complete a purchase on the spot, throughnetwork 150. For example, viewer 160 may use an interactive feature indisplay 175 so that viewing device 170 provides personal informationfrom viewer 160 to an account in service provider 101 through networklink 183. Vendor 105 may also have an account in service provider 101,so that service provider 101 may transfer funds from a viewer's accountto a vendor's account.

FIG. 4 shows a display 455 in a system for targeted commerce in networkbroadcasting, according to some embodiments. Display 455 includes acanvas to display a program content 420 and interactive box 225, asdescribed in detail above (cf. FIGS. 2 and 3). Thus, upon viewer 160showing interest on an item or service, a search engine 430 may displaya plurality of results 435 of a search for an item. Search engine 430may be running on a server in network 150. In some embodiments display455 includes payment tab 240, described in detail above (cf. FIGS. 2 and3). Thus, in some embodiments viewer 160 has a plurality of options topurchase an item or a service of interest. Different vendors listed inresults 435 may have a contract with search engine 430 to be displayedwithin results 435 according to a certain order. In some embodiments,the order in which results 435 are displayed may be selected accordingto relevance. For example, vendors producing a higher correlation valuewith keywords 107 or purchase profile 134 may appear above vendorsproducing a lower correlation value, in results 435. In someembodiments, vendors listed in results 435 may be highlighteddifferently, according to relevance.

Furthermore, in some embodiments results 435 may include interactivelinks to access a vendor webpage through network 150. In someembodiments, the vendor webpage may include payment tab 240, so thatviewer 160 may perform a purchase directly from viewing device 170.

FIG. 5 shows a flow chart in a method 500 for providing targetedcommerce in network broadcasting, according to some embodiments.According to some embodiments, method 500 may be performed by aninterface device receiving video programs or other multimedia streamsfor an audience that may be reached via traditional antennatransmissions, a cable network, or the internet (e.g., interface device130, cf. FIG. 1). The video programs or other multimedia streams may beprovided to a network by a broadcaster (e.g., broadcaster 110 andnetwork 150, cf. FIG. 1). The interface device may perform steps in FIG.5 electronically, using a processor circuit acting from commands anddata stored in a memory (e.g., processor 132 and memory 133, FIG. 1).The internet may include a cell phone network, a wireless network, anEthernet network, or any combination of the above. The audience mayreceive and display the multimedia data stream using a viewing devicehaving a display (e.g., viewing device 170 and display 175, FIG. 1).

In step 510, the interface device provides a contract to a vendor.According to some embodiments, the vendor may provide a keyword set uponagreeing to a contract in step 510 (e.g., keywords 107). In step 520,the interface device finds correlation values between the keywords andembedded metadata in a broadcasted multimedia data stream to bedisplayed for a viewer (e.g., multimedia stream 120 and viewer 160, cf.FIG. 1). The embedded metadata may include the close captioning for theprogram provided by the broadcaster. The embedded metadata may alsoinclude a description of the display content. Strong correlation betweenwhat is being said and what is being shown on the screen increases theprobability of displaying an advertisement.

In step 530, the interface device places an advertisement field atselected locations in the multimedia stream. In some embodiments, theinterface device places targeted advertisements in an advertisementfield (e.g., fields 230, 330, or 430, FIGS. 2, 3, and 4). The locationwithin the multimedia stream selected by the interface device to placeadvertisements include a point where a high correlation value is foundbetween keywords, close captioning, and the visual display (e.g.,keywords 107, close captioning 121, FIG. 1). Moreover, points where theinterface device places targeted advertisements in a multimedia streammay vary for different broadcasts of the same multimedia stream. Thus,when the contract provided in step 510 expires, the interface device mayremove advertisements related to the vendor whose contract expired. Insome embodiments, an interface device may include a ‘rotating’ schemefor placing targeted advertisements in a multimedia stream. For example,more than one vendor may desire to have targeted advertisements withsimilar keywords placed on ‘prime’ locations in a multimedia stream.This may be the case for vendors from a particular industry, such askitchenware manufacturers in cooking programs. Thus, an interface devicemay alternate targeted advertisements from different vendors at the sameor similar spot in a multimedia stream.

In step 540, the interface device places a payment tab on theadvertisement field (e.g., payment tab 240, cf. FIGS. 2, 3, and 4). Thepayment tab may establish a direct link between the viewer and serviceprovider 101. For example, service provider 101 may contact the viewerthrough link 171 (cf. FIG. 1). Thus, the viewer may purchase an itembeing advertised using methods and systems for targeted commerce innetwork broadcasting as disclosed herein. When the viewer presses ortaps on a payment tab, the interface device may transmit a message tothe service provider that a viewer is interested in a selected productfrom a vendor. The service provider may be configured to contact thevendor and the viewer to finalize purchasing transactions according toembodiments of method 500.

In step 550, the interface device displays targeted advertisements at apre-determined, viewer-selected event. To create a high impact upon aviewer when showing the advertisements, targeted advertisements may bedisplayed when a viewer pauses or fast-forwards the program. Thus, aviewer-selected event in step 550 may include a ‘pause’ action, a‘fast-forward’ action, or any other action on the multimedia stream(e.g., icons 350 and 351, cf. FIG. 3). For example, in some embodimentsa viewer-selected event in step 550 may include a ‘fast-forward’ action(icon 351, FIG. 3). Different points in the downstream of the programcontent may include different advertisements mapped to what is beingdisplayed or talked about within the program. For example, multipleadvertisements may be determined between a first pause and a secondpause by the viewer in a multimedia downstream, according to correlationmatches between the first and second pause. In such embodiments, step550 may include the broadcaster displaying the multiple advertisementsat the second pause by the viewer. In some embodiments, in step 550, theinterface viewer may choose to display a selected advertisement frommultiple advertisements having a correlation match. The selectedadvertisement may correspond to a vendor that has placed a bid with thebroadcaster to display the advertisement. In some embodiments, whilemultiple vendors may each place a bid with the broadcaster, thebroadcaster may choose the selected advertisement according to thehighest bid received.

FIG. 6 shows a flow chart in a method 600 for providing targetedcommerce in network broadcasting, according to some embodiments.According to some embodiments, method 600 may be performed by aninterface device receiving video programs or other multimedia streamsfor an audience that may be reached via traditional antennatransmissions, a cable network, or the internet (e.g., interface device130, cf. FIG. 1). The internet may include a cell phone network, awireless network, an Ethernet network, or any combination of the above.The audience may receive and display the multimedia data stream using aviewing device having a display (e.g., viewing device 170 and display175, FIG. 1). The video programs or other multimedia streams may beprovided to a network by a broadcaster (e.g., network 150 andbroadcaster 110, cf. FIG. 1). The interface device may perform steps inFIG. 6 electronically, using a processor circuit acting from commandsand data stored in a memory (e.g., processor 132 and memory 133, FIG.1).

In step 610, a viewer purchase profile is provided. The purchase profilemay be created by the interface device using the processor circuit andviewer history data stored in the memory (e.g., purchase profile 134,cf. FIG. 1). For example, the viewer history data may include priorpurchasing transactions performed by the viewer using method 500 (cf.FIG. 5), or method 600. In step 620, correlation values are foundbetween the purchase profile and embedded metadata in the multimediastream (e.g., metadata 122, cf. FIG. 1). Step 620 may be as described indetail above in relation to step 520 (cf. FIG. 5). In step 630, arequest is placed to the viewer to display commercial information abouta product or service according to correlation values. In someembodiments, the request may include a request to perform a networksearch using a search engine to find a plurality of vendors providing anitem or service selected according to a correlation value in step 620.Step 630 may be performed at pre-selected viewer actions such as pausinga multimedia stream or fast forwarding a multimedia stream. For example,if a program content in the multimedia stream is a cooking show and theprogram host is about to use a blender machine, an interface deviceperforming method 600 in step 630 may place a field on the screen withthe question for the viewer ‘would you like to shop blenders?’

In step 640, a payment tab is placed on an advertisement field in adisplay. Step 640 may be as described in detail above in relation tostep 540 (cf. FIG. 5). In step 650, vendor search results are displayedin the advertisement field. Thus, in the ‘blender’ example above, whenthe viewer taps on the ‘yes’ response (via a remote control device, orsimply by touching the screen on the display), in step 650 a searchresult for blender providers may be shown in a portion of the display.The search results may be listed in order according to price, accordingto a correlation between a viewer's purchase profile and the text in thesearch results, or simply according to a premium paid to the interfacedevice by the vendor. In some embodiments, step 650 may include theinterface device using a search engine operable in the network. In suchembodiments, vendors may pay a premium to the search engine operable inthe network, to be displayed at an advantage position in a searchresult.

In step 660, a vendor selection is received from the viewer from thesearch results displayed in step 650. In step 660, a selection may bereceived as the viewer presses or taps an active area on display 175. Instep 670, a purchase transaction is completed, similarly to step 570described in detail above (cf. FIG. 5).

FIG. 7 shows a flow chart in a method 700 for providing targetedcommerce in network broadcasting, according to some embodiments.According to some embodiments, method 700 may be performed by aninterface device receiving multimedia streams from a network (e.g.,interface device 130 and network 150, FIG. 1). The multimedia streamsmay include video programs for an audience that may be reached viatraditional antenna transmissions, a cable network, or the internet. Aninterface device may perform steps in FIG. 7 electronically, usingprocessor 132 acting from commands and data stored in memory 133 (cf.FIG. 1).

In step 710, the interface device receives data from a vendor aftersigning a contract to display advertisements of vendor's products orservices. The data may include a set of keywords associated to productsor services provided by the vendor. A service provider such as privateaccount service provider 101 may also have a contract with the interfacedevice to provide a method for online payment of products and servicesadvertised by the interface device. According to some embodiments, avendor having a contract with the interface device manufacturer may alsohave a private account with the service provider. Furthermore, a viewerhaving access to multimedia downstream from the broadcaster may alsohave a private account with the service provider (e.g., viewer 160, FIG.1). Thus, in step 720, the interface device may receive data from theservice provider. The data received in step 720 may be a purchaseprofile of items that the viewer may be interested in purchasing, or mayconsider purchasing (e.g., purchase profile 134, cf. FIG. 1).

In step 725, the interface device receives a multimedia stream. Forexample, the multimedia stream may be downloaded from the network. Insome embodiments, step 725 may include buffering the multimedia streamusing a memory in the interface device (e.g., memory 133, FIG. 1).Accordingly, in some embodiments step 725 may include storing themultimedia stream in a non-transitory, computer readable medium such asa DVD, a hard drive, a flash memory device, or any other type of memorydevice.

In step 730, the interface device determines if the keywords provided bythe vendor match a close captioning of a program content that theinterface device provides to viewers. If the vendor keywords do notmatch the close captioning of a given program content, the interfacedevice may display advertisements associated to products and servicesincluded in the purchase profile provided by the user, in step 795. Ifthe vendor keywords match the close captioning at some point of thestream, then in step 740, the interface device determines if the vendorkeywords also match a visual element in a frame of the displayassociated to the close captioning. For example, the interface devicemay perform step 740 by using the metadata associated with themultimedia downstream including the program content (e.g., metadata 122,cf. FIG. 1). If the interface device finds a match in step 740, then apremium is added for the vendor in an advertisement associated to theproduct or service matched in step 740.

Whether or not a match is found in step 740, in step 750, it isdetermined if multiple vendors have keywords matching the closecaptioning (step 730) or the frame display (step 740). For example,multiple vendors may provide keywords for a generic item (e.g.‘blenders’ or ‘travel’) that matches a word in the close captioning, anda portion of an image in the frame display. When the interface devicedetermines that no more than one vendor has a match in step 750, thenthe multimedia stream is provided to the viewer in step 770. When step750 determines that more than one vendor has a match, then in step 760the interface device requests and receives bids from the vendors thathave a match. In step 760, it is determined to display an advertisementfor the highest bidder. In some embodiments, step 760 may includefinding a probability value weighted according to the bid received fromthe vendors. In such embodiments, the interface device may display anadvertisement associated to a specific vendor, according to theprobability function.

In step 770, the targeted advertisement is stored in the memory.According to some embodiments, step 770 may include placing theadvertisement in the stream as the multimedia stream is provided to theviewer. In that regard, some embodiments may perform step 770 togetherwith step 780, described in detail below.

In step 780, the multimedia stream including the program content andadvertisements is provided to the viewer. In some embodiments, step 780is performed with a pre-selected delay, relative to the streaming of themultimedia stream content by the broadcaster into the network. Forexample, in some embodiments the delay in step 780 may be of a fewminutes, or half an hour, or even more than an hour. Accordingly, insome embodiments the viewer may replay the multimedia stream severalhours, or days, after the broadcaster placed the multimedia stream inthe network. In such embodiments, the viewer may replay the multimediastream from a recording in a DVD, CD, or any other non-transitory,computer readable medium where the interface device stored themultimedia stream.

In step 785, the interface device determines whether the viewer hastaken an action on the program. For example, in step 785 the interfacedevice may determine whether the viewer has paused or fast forwarded theprogram stream. If the viewer has not paused, nor fast forwarded theprogram stream, then in step 787, it is determined whether the programhas ended. If the program has not ended, then the interface devicecontinues to provide multimedia stream in step 780. If in step 787, itis determined that the program has ended, or in step 785 it isdetermined that the viewer has paused the program, then in step 790, theadvertisement stored in step 770 is displayed for the viewer. In someembodiments, multiple advertisements may be displayed in step 790, asthe memory in the interface device may have more than one targetedadvertisement stored. For example, in some embodiments steps 730 through770 may be repeated in multiple portions of a multimedia stream, beforea viewer pauses the program in step 785, or the program ends in step787.

In some embodiments, method 700 may include step 795 where targetedadvertisements are displayed for products or services in the viewer'swish-list provided by the service provider. In some embodiments, in step795, products or services under promotion by a vendor, or a product thata vendor desires to place in the market at a premium price for thevendor, may be displayed for the viewer.

Accordingly, in embodiments as disclosed herein steps 790 and 795 mayinclude placing ‘smart ads’ including a payment tab (e.g., payment tab240, FIG. 2) so that the viewer may immediately purchase an advertiseditem through an account in a service provider (e.g., service provider101, FIG. 1).

Embodiments of the invention described above are exemplary only. Oneskilled in the art may recognize various alternative embodiments fromthose specifically disclosed. Those alternative embodiments are alsointended to be within the scope of this disclosure. As such, theinvention is limited only by the following claims.

What is claimed is:
 1. A system for targeted commerce in networkbroadcasting comprising: an interface device configured to: receive amultimedia stream from a network, wherein the multimedia streamcomprises a closed captioning string; determine first correlationsbetween a user profile and the closed captioning string and metadatadescribing the contents of a video frame of the multimedia stream;increase a probability that corresponding advertisements will beprovided in the multimedia stream when the first correlations include asecond correlation between the user profile and the closed captioningstring and a third correlation between the user profile and themetadata; determine the corresponding advertisements based on theincreased probability; process the multimedia stream by providing thecorresponding advertisements in the multimedia stream according to thedetermination; and provide the processed multimedia stream for viewing.2. The system of claim 1, wherein the user profile comprises a wish listof products of interest to a viewer.
 3. The system of claim 1, whereinthe user profile comprises data associated with prior purchasingtransactions.
 4. The system of claim 1, wherein the interface device isfurther configured to sort the corresponding advertisements based on thefirst correlations.
 5. The system of claim 1, wherein the interfacedevice is further configured to determine whether a viewer desires toview the corresponding advertisements and provide the correspondingadvertisements based on the determination.
 6. The system of claim 1,wherein the interface device is further configured to determine fourthcorrelations between vendor keywords and the closed captioning stringand the metadata.
 7. The system of claim 6, wherein the interface deviceis further configured to further increase the probability that thecorresponding advertisements will be provided in the multimedia streamwhen the fourth correlations include a fifth correlation between theclosed captioning string and the vendor keywords and a sixth correlationbetween the video frame metadata and the vendor keywords.
 8. The systemof claim 6 wherein the interface device is further configured to:request a bid from each of a plurality of vendors having vendor keywordscorrelated by the fourth correlations; and select a first advertisementfrom a first vendor from the plurality of vendors with a highest bid. 9.The system of claim 1, wherein the interface device is furtherconfigured to place a payment tab in the multimedia stream.
 10. Thesystem of claim 9, wherein the payment tab includes a link to a serviceprovider to facilitate a purchase of a product included in one of thecorresponding advertisements.
 11. The system of claim 1, furthercomprising a viewing device configured to receive the processedmultimedia stream and display it to a viewer.
 12. The system of claim11, wherein the viewing device comprises an interactive display.
 13. Amethod for targeted commerce, the method comprising: receivingelectronically a multimedia stream from a network, wherein themultimedia stream comprises a closed captioning string; determiningfirst correlations between a user profile and the closed captioningstring and metadata describing the contents of a video frame of themultimedia stream; increasing a probability that correspondingadvertisements will be provided in the multimedia stream when the firstcorrelations include a second correlation between the user profile andthe closed captioning string and a third correlation between the userprofile and the metadata; searching for the corresponding advertisementsbased on the increased probability; processing the multimedia stream byproviding the corresponding advertisements in the multimedia streamaccording to the search; and providing the processed multimedia streamfor viewing.
 14. The method of claim 13, wherein the user profilecomprises at least one of a wish list of products of interest to aviewer and data associated with prior purchasing transactions.
 15. Themethod of claim 13, further comprising sorting the correspondingadvertisements based on the first correlations.
 16. The method of claim13, further comprising: placing a payment tab in the multimedia stream,the payment tab including a link to a service provider; and facilitatinga purchase of a product included in one of the correspondingadvertisements using the link.
 17. The method of claim 13, furthercomprising: determining whether a viewer desires to view thecorresponding advertisements; and providing the correspondingadvertisements for viewing based on the determination.
 18. Anon-transitory machine-readable medium comprising a plurality ofmachine-readable instructions which when executed by one or moreprocessors of an interface device are adapted to cause the interfacedevice to perform a method comprising: receiving electronically amultimedia stream from a network, wherein the multimedia streamcomprises a closed captioning string; determining first correlationsbetween a user profile and the closed captioning string and metadatadescribing the contents of a video frame of the multimedia stream;increasing a probability that corresponding advertisements will beprovided in the multimedia stream when the first correlations include asecond correlation between the user profile and the closed captioningstring and a third correlation between the user profile and themetadata; searching for the corresponding advertisements based on theincreased probability; processing the multimedia stream by providing thecorresponding advertisements in the multimedia stream according to thesearch; and providing the processed multimedia stream for viewing. 19.The non-transitory machine-readable medium of claim 18, wherein the userprofile comprises at least one of a wish list of products of interest toa viewer and data associated with prior purchasing transactions.
 20. Thenon-transitory machine-readable medium of claim 18, wherein the methodfurther comprises sorting the corresponding advertisements based on thefirst correlations.